Papers with acceleration inference
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting (2022.coling-1)
Copied to clipboard
| Challenge: | Existing competitive methods to accelerate inference of pretrained language models are limited by their complexity and computational consumption. |
| Approach: | They propose a unified horizontal and vertical multi-perspective early exiting framework to accelerate inference of transformer-based models. |
| Outcome: | Experiments show that MPEE can achieve higher acceleration inference with competent performance than existing competitive methods. |